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Chapter Problems 


6.3.0 Chapter Problems 


Problem 1 

Let X , Y and Z be three jointly continuous random variables with joint PDF 


( x + y o < x,y,z < 1 
fxYz{x, y, z) = < 

I 0 otherwise 


1. Find the joint PDF of X and Y . 

2. Find the marginal PDF of X. 

3. Find the conditional PDF of fxY\Z { x : V \ z ) using 


fxY\z( x ,y\z) 


fxYzi x ,y, z) 
fz(z) 


4. Are X and Y independent of Zl 


Problem 2 

Suppose that X , Y, and Z are three independent random variables. If X , Y r->J N( 0,1) 
and Z ~ Exponential l),fmd 

\.E[XY\Z - 1], 

2.E[X 2 Y 2 Z 2 \Z = 1]. 


Problem 3 

Let X, Y, and Z be three independent iV( 1, 1) random variables. Find 

E[XY\Y + Z = 1]. 


Problem 4 

Let Xi,X 2 ,- • ’,X n be i.i.d. random variables, where X{ ~ Bemoulli(p ) . Define 
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Vi = XiX 2l 
y 2 = X 2 X 3 , 


Yn —1 — Xn—lXm 

Yn = X„Xl . 


if Y — Y\ + Y2 + • • • + find 

1. ^in 

2. Var(y). 


Problem 5 

In this problem, our goal is to find the variance of the hypergeometric distribution. Let's 
remember the random experiment behind the hypergeometric distribution. You have a bag that 
contains b blue marbles and V red marbles. You choose k < b + V marbles at random 
(without replacement) and let X be the number of blue marbles in your sample. Then 
X ~ Hypergeometric(b, r, k ). Now let us define the indicator random variables X{ 
as follows. 


f 1 if the ith chosen marble is blue 
[ 0 otherwise 

Then, we can write 

X = Xi + x 2 + • • • + x k . 


Using the above equation, show 


1 EX 


kb 

b+r ’ 


2. Var(X) = 


kbr b+r-k 
(b+r ) 2 b+r-l ' 


Problem 6 

(MGF of the geometric distribution) If X ~ Geometric^p), find the MGF of X. 


Problem 7 

if Mx{s ) = j + je s + je 2s , find EX and Var(X). 


Problem 8 
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Using MGFs show that if X r->J N(nx,<Jx) and Y ~ N(hy , <Jy ) are independent, 
then 


X + Y - 


N I 


Mx + Mr? 


Problem 9 

(MGF of the Laplace distribution) Let JC be a continuous random variable with the following 


PDF 


fx(x) 


—e~ x \ x \. 

2 


Find the MGF of X , 


Problem 10 

(MGF of Gamma distribution) Remember that a continuous random variable X is said to have 
a Gamma distribution with parameters Ct > 0 and A > 0, shown as 
X ~ Gamma(a, A), if its PDF is given by 


fx(x) 


X a x a - 1 e~ Xx 

r(a) 


0 


x > 0 

otherwise 


If X ~ Gamma (a, A), find the MGF of X . Hint: Remember that 
J 0 °° x a ~ l e~ Xx dx — for ct, A > 0. 


Problem 11 

Using the MGFs show that if Y — X\ + X 2 + • • • + X n , where the Xj's are 
independent Exponential (A) random variables, then Y ~ Gamma{n , A). 


Problem 12 

Let X be a random variable with characteristic function (f)x (w) If Y — aX + b, show 
that 


4>y{w) — e^ b 4 >x{cujo). 


Problem 13 
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Let X and Y be two jointly continuous 


random variables with joint PDF 


fx,Y («£? y) 


|(3 x + y) 0 < x,y < 1 

0 otherwise 


and let the random vector U be defined as 


u = 


X 

Y 


1. Find the mean vector of U, E U. 

2. Find the correlation matrix of U, Ru 

3. Find the covariance matrix of U, Cu- 


Problem 14 

Let X ~ Uniform(0, 1). Suppose that given X — X, Y and Z are independent and 
Y\X — x ~ Uniform(0,x) and Z\X — x ~ Uniform(0,2x). Define the 
random vector U as 


u = 


X 

Y 

Z 


1. Find the PDFs of Y and Z . 

2. Find the PDF of U, f\j (u) , by using 

/u(u) = fxYz(x,y,z) 

= fx(x)f Y \x{y\x)fz\x,Y( z \ x ’y)- 


Problem 15 

Let 


x = 


X 1 

_X 2 _ 


be a normal random vector with the following mean and covariance matrices 
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Let also 



~1~ 

,C = 

'4 

1' 

m — 





2 


1 

1 



Y = 


Vi 

r 2 

y 3 


AX + b. 


1. Find P(X 2 > 0). 

2. Find expected value vector of Y, my = -EY. 

3. Find the covariance matrix of Y, Cy 

4. Find P{Y 2 < 2). 


Problem 16 


Let X = 


X x 

X 2 

*3 


be a normal random vector with the following mean and covariance 


m = 


1 

2 

0 


5 


c = 


9 

1 

-1 


1 -1 

4 2 

2 4 


Find the MGF of X defined as 
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Mx(s,t,r) 


E 


-\-tX 2-\-rX$ 


Problem 17 

A system consists of 4 components in a series, so the system works properly if all of the 
components are functional. In other words, the system fails if and only if at least one of its 
components fails. Suppose the probability that the component i fails is less than or equal to 
Pf — , for i — 1 , 2, 3, 4. Find an upper bound on the probability that the system fails. 

Problem 18 

A sensor network consists of 71 sensors that are distributed randomly on the unit square. Each 
node's location is unifonn over the unit square and is independent of the locations of the other 
node. A node is isolated if there are no nodes that are within distance T of that node, where 
0 < r < 1. 

1. Show that the probability that a given node is isolated is less than or equal to 
Pi = 

2. Using the union bound, find an upper bound on the probability that the sensor network 
contains at least one isolated node. 


Problem 19 

Let X ~ Geometric(p) . Using Markov's inequality find an upper bound for 
P(X > a) , for a positive integer a. Compare the upper bound with the real value of 

P{X > a). 


Problem 20 

in Geometric(p ). Using Chebyshev's inequality find an upper bound for 

P(\X-EX\>b). 


Problem 21 

(Cantelli's inequality [16]) Let X be a random variable with EX — 0 and 
Var(X) = <7 2 . We would like to prove that for any a > 0, we have 


P(X >a)< 


<j 


2 


CT 2 + a 2 ' 


This inequality is sometimes called the one-sided Chebyshev inequality. Hint: One way to 
show this is to use P(X > a) = P(X + C > a + c) for any constant C £ R. 
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Problem 22 

The number of customers visiting a store during a day is a random variable with mean 

EX = 100 and variance Vlir(X) — 225. 

1. Using Chebyshev's inequality, find an upper bound for having more than 120 or less 
than 80 customers in a day. That is, find an upper bound on 

P(X < 80 or X > 120). 

2. Using the one-sided Chebyshev inequality (Problem 21), find an upper bound for having 
more than 120 customers in a day. 

Problem 23 

Let X{ be i.i.d. and X 7 ; ~ Exponential^ A) . Using Chernoff bounds find an upper 
bound for P{X\ + X 2 + • • • + X n > a), where a > y. Show that the bound goes to 
zero exponentially fast as a function of 71. 

Problem 24 

(Minkowski's inequality [17]) Prove for two random variables X and Y with finite moments, 
and 1 < p < OO, we have 

E[\X + Y\ p ]v < E[\X\ p }i +E[\Y\ P ]E 

Hint: Note that 

\X + Y\ P = \X + Y\ p ~ l \X + Y\ 

< |x + y| p_ 1 (|x| + |y|) 

< |x + y| p_ 1 |x| + |x + y| p_ 1 |y|. 

Therefore 

E\X + Y\ P < ^[|X + y| p_1 |X|] +E[\X + Y\ p ~ l \Y\]. 

Now, apply Holder's inequality. 

Problem 25 

Let X be a positive random variable with EX — 10. What can you say about the following 
quantities? 

i.E[X-X 3 ] 
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2 .E x\nyfx\ 

2>.E[\2-X\] ' 


Problem 26 

Let X be a random variable with EX — land R x = (0,2).ify = X 3 -6X 2 , 
show that EY < —5. 

previous 
next —> 
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